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Hierarchical models of scale free networks are introduced where num- 
bers of nodes in clusters of a given hierarchy are stochastic variables. Our 
models show periodic oscillations of degree distribution P(k) in the log- 
log scale. Periods and amplitudes of such oscillations depend on network 
parameters. Numerical simulations are in a good agreement to analytical 
calculations. 
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1. Introduction 

Recently there is a large interest in scale-free networks that seem to be 
good approximations for such systems as the Internet, World Wide Web, 
social or biological networks; for a review see A simple model that 

exhibits the power law for degree distributions P{k) observed in real com- 
plex networks is the Barabasi- Albert model of preferential attachment 
The model however suffers from very low values of the clustering coefficient 
C 5 for large networks as compared to observations of real systems 
To overcome this discrepancy a model of hierarchical networks has been 
introduced by Ravasz and Barabasi (RB) where the clustering coefficient is 
much larger |BJ. The RB network consists of hierarchically connected clus- 
ters where numbers of nodes in every cluster of a given hierarchy are the 
same. The degree distribution P(k) in this approach also exhibits power- 
law. However, it is only a general trend. In fact, the degree distribution 
consists of delta-peaks for only a few degree values, instead of continuous 
distribution observed in real networks. In this paper, we introduce a class of 
more general models, where number of nodes in every cluster is a stochastic 
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variabl, what seems to be more justified for real network models. As result 
the peaks of P(k) are blurred, creating a network with wide range of possi- 
ble k values, but the log-periodic behaviour of P{k) is still clearly visible. 
Let us remind that log-periodic oscillations are characteristic features of 
systems where a discrete self-similarity is present (7j and the effect can 
occur even without a preexisting hierarchy [7j in such various systems as 
earthquakes [SJ |5] or financial markets where log-periodic oscillations were 
observed as possible precursors for financial crashes ^3 . Such os- 

cillations were also found for mean residence times at chaotic crisis where a 
collision of a fractal attractor with a fractal or a nonfractal basin of another 
attractor takes place |131 114j and for the stochastic resonance in chaotic 
systems near a crisis point [15] . 

2. The Model 

Our model possesses two parameters, a distribution Pjvf(m), where m = 
1, 2, 3, . . . and a number p € (0, 1]. We start out from a single cluster (a 
cluster of hierarchy 0) of m + 1 fully connected nodes (FigQ), where m is a 
random number from a distribution Pj^(m). One node in the cluster is its 
central node. The central node of the cluster is a center of hierarchy 0. Next, 
we call our cluster the central one and create a random number m of similar 
clusters. Each is created in the same way as the central cluster, but we pick 
a random number m for each one independently, therefore they may include 
different numbers of nodes. Next, we connect a part p of all nodes in non- 
central clusters to the central node in the central cluster. This node becomes 
the central node for the whole cluster of hierarchy 1 we have obtained so 
far. Similarly the central node of our cluster is a center of hierarchy 1. We 
repeat the process, until we get a network of a desired hierarchy. This model 
is referred to as PI model. The model is generalization of the stochastic 
model proposed by Barabasi and Ravasz |SJ. If we take Pm(™) = S(m, mo), 
where uiq is constant, our model simplifies to BR model, with number of 
nodes and degree distribution determined strictly by p and mo values. 

A variation of the model has been also studied. In each hierarchy d we 
connect not a fraction p of nodes but a fraction p d . This model is referred 
to as the PD model. 

3. Degree Distribution of PI and PD models 

As previously noted, for Pm{™) = S(m, mo) we get a degree distribution 
identical to that of BR model. It consists of separate peaks, corresponding 
to degrees of central nodes of following hierarchies. Central nodes of given 
hierarchy have a fixed degree, dependent only on the network parameter 
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Fig. 1. The first three steps of network creation in the PI model. 

p. At the logarithmic scale the distance between neighboring peaks is ap- 
proximately constant and equals to log(mo + 1). The peaks follow laws of 
discrete scaling [7]. The heights of peaks with degrees ki decrease as k i 7 , 
and distances between consecutive peaks fulfill the relation ki+x/ki = A. 
The probability P(k) between peaks equals to zero what means that only 
nodes with peculiar degrees are possible. But what happens when the num- 
ber m is not a fixed value ? 

Numerical simulations show that each peak blurs, depending on the PM{m) 
distribution. If the blur is small, the distribution consists of separate peaks, 
but they are not delta-shaped. If the blur is large enough, the peaks overlap 
and a continuous degree distribution is obtained. Figure^ shows degree dis- 
tributions for both cases in PI model. Both display a discrete scaling, and 
have the same scaling exponent (up to statistical fluctuations), independent 
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Degree distribution for hierarchical network with log-periodic oscillations 
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Fig. 2. Degree distribution for two networks with different Pm{iti). Filled circles 
are for m = 3 or 4 with equal probability, gray circles are for uniform m distribution 
between 1 and 5. The straight lines show scaling of peak heights and correspond to 
7 = 0.967 for the first case (continuous line) and 7 = 0.973 for the second (dotted 
line) . 



on network parameters. 

Similar behavior has been observed in the PD model, although scaling ex- 
ponent is parameters dependent. 



4. Mean m value approach 



Numerical simulations have shown that when m is not a constant but 
a random number from a given distribution, peaks blur, eventually over- 
lapping and creating a continuous distribution. However, regardless of the 
actual shape, the distribution still consists of peaks. Each peak has an av- 
erage degree k and a mass n representing number of nodes that belong to 
this peak. All nodes in a peak are centers of the same hierarchy. Using a 
mean value of m, the distance between peaks and their relative heights can 
be easily found. From these two values we directly get the discrete scaling 
ratio A and the scaling exponent 7. In the following calculations we neglect 
the degree increase of nodes due to their connections to the central cluster, 
as this effect increases the node degree at most by d, what is insignificant 
for higher hierarchy centers. 
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4-1. PI model 

Let us denote an average degree of peak of hierarchy d by kd, an average 
number of nodes in a cluster of hierarchy d by Nd, and an average number 
of centers of hierarchy d in a network of hierarchy h by n^. The network size 
Nd increases exponentially with hierarchy d as = (m + l) d+1 . Centers of 
hierarchy have a degree ko equal to (m) and it increases by p ■ (m) ■ iV^-i 
in each next hierarchy d. We obtain 

k d = (m) + p- (m + 1) • ({m + l) d - l) (1) 

If (m + 1) > 1 and d » 1, the above expression can be simplified to 

k d « V ■ (m + (2) 

If the condition is not satisfied, distances between peaks are not constant 
at logarithmic scale and the network is not scale-free. 

Since the discrete scaling ratio A simply equals kd+i/kd thus we get 
A « (m + 1). 

The scaling exponent 7 can be found using the cumulative degree dis- 
tribution. Starting from 

F[k) ~ ~Ak~ ~ ~KTAk {d) 

where d are consecutive hierarchies, and using calculations presented in 
Appendix we get P(k) ~ k~ 2 so the scaling exponent 7 equals to 2, 
regardless of p and Pm(itt-)- Note that this scaling is valid for peak masses 
n 1 ^ only. 

4.2. PD Model 

The case of PD model is very similar to the PI model. However, since 
instead of a fraction p we connect a fraction p d of nodes from non-central 
clusters, the degree kd is 

l-(p-{m+l)) d+1 
kd = (m) — — —. —. — (4) 

When we assume that p ■ (m + 1) > 1 we can omit one in the numerator 
and get the discrete scaling ratio A = kd+i/kd ~ p ■ (m + 1). Similarly to 
the PI model, if it is not true, the network is not scale-free. 

To find the scaling exponent, again we use cumulative degree distribution 
and Eq|3 For the PD model we get 7 = 1 + i^n^qrn ■ Note that since 
p G (0, 1] and p (m + 1} > 1 for scale-free networks, the scaling exponent is 
always greater than 2. 
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1.981 


0.398 
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1 to 3 


3 
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1.978 


0.477 


0.461 


1 to 4 


3.5 


2 


1.931 


0.544 


0.556 


1 to 5 


4 


2 


1.973 


0.602 


0.606 



Table 1. Distribution of m numbers, analytic and numerical scaling exponents 7 
and the logarithm of discrete scaling ratio A for the model PI. Data obtained from 
averaging over 30 networks. 
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0.32 



Table 2. Distribution of m numbers, analytic and numerical scaling exponents 7 
and the logarithm of discrete scaling ratio A for the model PD. Data obtained from 
averaging over 2000 networks. In the first row, the exact A value was impossible to 
obtain, due to very weak periodic behavior. 

4-3. Numerical Data 

Numerical simulations have been performed for networks of hierarchy 6, 
with p = 0.5 and various uniform distributions of m, to find out if analytic 
predictions are correct. 

Tables ^ an d 121 contain obtained data. Figure 01 shows the comparison 
between prediction and results. 

As it can be seen the numerical data are in a good agreement with our 
analytic predictions. The largest deviation is for low (m) and for low p, 
where our approximations were poor. 

5. Exact degree distribution 

Up to now, all calculations have been performed using only the average 
m value, treating the degree distribution as series of peaks. We have been 
concentrating on relations between peak's masses and distances, while ig- 
noring their shape. Here we find a shape of the degree distribution for the 
PI model. 

Let Pjvf(m) be a distribution of m, where m is a number of noncentral clus- 
ters in each hierarchy. Let Pd(N) be a distribution of the network sizes N 
for hierarchy d. Pd(k) is a degree distribution for a network of hierarchy d, 
PS(k) is a degree distribution for the central node of hierarchy d. 

The number of nodes in the network can be found as follows. Network 
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Discrete scaling ratio and scaling exponent for PI and PD models 
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Fig. 3. The discrete scaling ratio A and the scaling exponent 7. Symbols arc values 
obtained from numeric simulations, lines are analytic predictions. Diamonds and 
dotted line are for A in PI model. Squares and dashed line are for A in PD model. 
Circles and smooth line are for 7 in PD model. In all cases, networks are of 
hierarchy 6, with parameter p — 0.5. 

of hierarchy d = has m + 1 nodes what means Pq(N) = Pm(N — !)• The 
size of each next hierarchy d + 1 is a sum of m + 1 independent values, which 
are sizes of networks of hierarchy d. 

Pd+i(N) = ^P M (m) Yl Pd(n 1 )P d (n 2 )...P d (N-n m -...-n 1 ) (5) 

m n\,ni,...,n m 

This recursive formula describes the probability distribution for the network 
size N. 

A network of hierarchy d = has degree distribution Po(k) = Pm(^)- 
This distribution describes both regular nodes and a center of hierarchy 
0, which have the same degree values. In each next hierarchy d + 1 the 
degree distribution for all nodes of hierarchy d or less is the same, since we 
omit the degree increase due to connections to the central node of higher 
hierarchy. Now, we multiply the distribution by (m + 1) and add the degree 
distribution -Pf +1 (fc) for the central node of the network. This way we obtain 
an unnormalized degree distribution for the whole network of hierarchy d+1. 

Pd + i{k) =£[(m+ l)P M (m)P d (k) + P c d+l (k)} (6) 

m 

The center is roughly connected to fraction p of all nodes in the network, 
what means it possesses the degree p ■ N. This yields the distribution of its 
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degree equal to P\(k) = P\{k/p). As result we obtain 

P d+1 (k) =J2[(m + l)P M (m)P d (k) + P d+1 (k/p)] (7) 

m 

This recursive formula describes the unnormalized degree distributions 
for networks of consecutive hierarchies d, with the exception of d = 1. Since 
Po(k) describes not only centers of hierarchy but both regular nodes and 
centers, we must account for that. We do so by multiplying Po(k) in the 
formula by the average basic cluster size (m + 1). 

p i( k ) = E [< m + !> ( m + l)PM(m)P (k) + Pxik/p)] (8) 

m 

In the above calculations, like in the calculations using average m, we 
omitted the degree increase due to connections to the central node of higher 
hierarchy. This is insignificant for higher hierarchy centers, as the increase 
is at most d, while the center degree increases exponentially with d. We 
have used the formula P d (k) = P d (k/p) in the above calculations. In reality 
degree distributions are discrete, with natural k values. Depending on how 
we round the number of connections to the central node, we should interpret 
the above formula accordingly. 

We rounded the number of connections p ■ N down, what gives the fol- 
lowing formula for interpreting the probability with fractional argument 

PS(k)= E PdW (9) 
l>k/p,K(k+l)/p 

It means that the probability of getting the center of degree k equals to the 
sum of probabilities for N, that lead to this k. Along with 

P (N) = P M {N - 1) (10) 

and 

P (k) = P M (k) (11) 

Easlol and 17191 allow to find numerically an exact but unnormalized degree 
distribution for the PI model. 

Comparing these formulas with numerical data one can see that our 
calculations are correct for higher degrees, where approximations we used 
are accurate (Fig03 Fig|l]). 

Using degree distributions obtained with our formulas fEal5lEas l7lll|) . 
a relation between the distribution of m and a peak shape has been found. 
We have studied various uniform distributions of m and have found linear 
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Analytic and numeric degree distribution 
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Fig. 4. Degree distribution for the network with uniform m distribution from 1 
to 5, and hierarchy d — 5. The graph shows analytic (crosses) and numeric data 
(circles). 
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Analytic and numeric degree distribution 
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Fig. 5. The degree distribution for network with the uniform m distribution (3 or 
4), and the hierarchy d = 4. The graph shows analytic (crosses) and numeric data 
(circles) . 



relation between the standard deviation of the distribution P(lnm) and the 
standard deviation of peaks in the PQnk) distribution (FigEJ). 

Peak deviations in the distribution P(k) are calculated at the logarithmic 
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Fig. 6. Relation between the peak width wk (a standard deviation of peaks in 
P(lnfc)) and the distribution width wm (a standard deviations of P(lnm)). The 
slope of the line is a = 0.722. 



scale of k 

E(lnfc-(lnfc)) 2 -P(lnfc) 

a = pn i \ ( 12 J 

22PQnk) 

Similar formula has been used to calculate the deviation of P(m). Peak 
deviations have been calculated for the peak of the highest hierarchy. In 
the case of overlapping peaks the minimums of P(k) have been considered 
borders of peak. The approximation is quite accurate, as P(k) decays fast 
when we go away from the peak average k value. 



6. Discussion 

The question occurs, whether our model corresponds to real network 
systems. It is obvious that many real networks posess a hierarchical struc- 
ture but of course a detailed mechanism responsible for its emergence is 
unknown. According to our knowledge, log-periodic oscillations around the 
power law in degree distributions were never directly reported in the studies 
of real networks or corresponding models. One can suspect however, that 
in many cases such oscillations were visible and could be overlooked if the 
binning or data averaging had been performed. Small amplitude oscillations 
can be also easily confused with random fluctuations. The situation resem- 
bles oscillations around the scaling law in chaotic crises, where the periodic 
part is also often omitted as fluctuations |13l I14j . 
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A clear example of log-periodic oscillations for real networks can be seen 
in the study of liability connections between Austrian banks As the 

authors stress ^H] a significant part of studied banking sector posesses a 
strong hierarchical structure, what can be easily detected looking at a cor- 
responding connection graph. Two periods of oscillations can be identified 
at out-degree distribution describing the number of liabilities to other Aus- 
trian banks (regardless of liability size) ^S] . The period of the oscillations is 
approximately A = fcj+i/fcj ~ 3. According to our theory, they are a result 
of the network's hierarchical structure. 

We have found also far less visible oscillations in the studies of computer di- 
rectory trees and World Trade Web ^S] , where the hierarchical structure 
can be identified at a corresponding connection graph XI ^ or in dependence 
of a clustering coefficient on a node degree [IS] . Sizes of such oscillations are 
however at a fluctuations level. The other possible example can be found 
in the paper ^U], that presents a non-monotenous behavior of degree dis- 
tribution of P(k) for a shareholding network in Japan. Here a single wave 
around the power law can be observed, where A = ki + \/ki ~ 10. 

7. Conclusions 

In conclusion we have shown that hierarchical networks models display 
log-periodic oscillations in the degree distribution when the number of clus- 
ters forming the self-similar hierarchy is a stochastic variable. The period 
and the amplitude of these oscillations reflect the hierarchical structure of 
the network. We also point out examples of real networks that display such 
features. It follows that observations of log-periodic oscillations in degree 
distributions of real networks can give hints towards the existence of hidden 
hierarchical structures in such systems. 
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Appendix A 

Mean m value calculations 

This Appendix contains exact calculations regarding the discrete scaling 
ratio A and the scaling exponent 7 for the mean m approach. The number 
kd is an average degree of peak of hierarchy d, is an average number 
of nodes in network of hierarchy d, is an average number of centers of 
hierarchy d in a network of hierarchy h. The number {m + 1) is a mean 
number of clusters in each hierarchy. 

The Eq|2]can be obtained as 

i=i 

kd = kd-i + (m) • iV d _i • p = (m) + p ■ (m) ■ (m + 1)* = (A.l) 

d 

= (m) + p ■ (m + 1) • ((m + l) d — lj 

The scaling exponent 7 for model PI has been obtained using the cu- 
mulative degree distribution 

p,,s _ APcum _ AP cum Ad 
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First we find an expression for n^. There is only one center of hierarchy 
d = h in the network of such a hierarchy. Each time the network hierarchy 
h increases, the number of centers of hierarchy d increases (m + 1) times. 
The exception is the first step, where one node becomes center of the higher 
hierarchy. Because of that increases only by the factor of (m) for that 
step. We obtain v!\ = (m) ■ (m + 1) ~ _1 except for n h h = 1. 

Now we calculate expressions in Eq lA.2l Each next peak is smaller 
A aX" = v!\ ~ (m + l)~ d while its average degree kd increases ~ 
(m + l) d In such a way we obtain 

P(k) ~(m + iy d .( m + \y d =( m + l)~ 2d (A.3) 

From Ea IA. II we get d ps log (m+1) | - 1 = ^(m+i) ~ L B ^ putting so 
calculated d into Ea lA.3l we get 

P{k) ~ (m + iy 2d = exp (-2dm (m + 1}) = (A.4) 

exp (-2—. ^ In (m + 1} + 2 In (m + 1) ] ~ exp (-2 In k) = k~ 2 

\ In (m + 1) / 

For the P-D model the Eq^Jcan be obtained in the following way 

k d = k d -i + (m) ■ N d -i ■ p d = (A.5) 
1 - (p- (m + 



(m) ■ yjp* • (»7i + 1)* = (m) 



1 — p • (m + 1} 



The scaling exponent has been calculated in a similar way to the case 
of model PI. The slope AP cum / Ad is the same as in the previous case but 
Ak/Ad ~ (p ■ (m+ l)) d thus P(fc) ~ p~ d • (m + 

Expressing d by A; we get d = log p ^ m+1 ^ (P'( m +^)- i y k — 1 and putting 

M I ln(m+l) \ 

that into Eq lA.2l we get P(k) ~ in P ( m +i)> which yields exponent 7 

ln(m+l) 
lnp(m+l 



1 + £&±V for PD model. 



